Multi-feed context enhanced imaging

ABSTRACT

A system or method includes a platform to allow users to coordinate images captured by a separated camera with images captured by a first camera, displaying such images at real-time to a user through a user interface on the first camera or a user interface on a separate device. The separate camera is contemplated to provide a separate image feed to provide one or more augmentations to an image captured by the first camera.

This application is a continuation of U.S. patent application Ser. No.16/428,827, filed on May 31, 2019. This application and all otherreferenced extrinsic materials are incorporated herein by reference intheir entirety. Where a definition or use of a term in a reference thatis incorporated by reference is inconsistent or contrary to thedefinition of that term provided herein, the definition of that termprovided herein is deemed to be controlling.

FIELD OF THE INVENTION

The field of the invention is mixed and extended reality environments.

BACKGROUND

The following description includes information that may be useful inunderstanding the present invention. It is not an admission that any ofthe information provided in this application is prior art or relevant tothe presently claimed invention, or that any publication specifically orimplicitly referenced is prior art.

Various efforts have been placed in providing users with a platform tosend captured images and receive the captured images in users' mobilephone. Exemplary platforms include Skype talk and live lectures allowusers to receive captured images on their mobile phone and computers.

These and all other publications identified in this application areincorporated by reference to the same extent as if each individualpublication or patent application were specifically and individuallyindicated to be incorporated by reference. Where a definition or use ofa term in an incorporated reference is inconsistent or contrary to thedefinition of that term provided in this application, the definition ofthat term provided in this application applies and the definition ofthat term in the reference does not apply.

There are instances in the prior art describing the use of capturedimages in US Patent Application Publication No. US 2010/0026809 A1 toCurry. Curry discloses a method of controlling a camera using a computerto track the movement of a particular subject in a sporting event.However, Curry fails to disclose a method of engaging a user inaugmented reality with additional context and advanced imageprocessing/tracking technologies applied. Curry merely disclosesdetermining the position of a subject and switching cameras to cover thesubject based on the subject coming into the field of view of one ormore cameras in a venue.

All publications identified herein are incorporated by reference to thesame extent as if each individual publication or patent application werespecifically and individually indicated to be incorporated by reference.Where a definition or use of a term in an incorporated reference isinconsistent or contrary to the definition of that term provided herein,the definition of that term provided herein applies and the definitionof that term in the reference does not apply. In this patentapplication, a camera is installed on a person or a object, and capturedimages by the camera were sent to and viewed by mobile phones and/orcomputers owned by the third party.

As another example, a lecture is recorded by a camera and sent to andviewed at real-time and/or later by a mobile phone and/or computer ownedby the third party.

As used herein, “mixed reality” comprises the merging of real andvirtual worlds to produce new environments and visualizations wherephysical and digital objects co-exist and interact in real time.Additionally and as used herein, “extended reality” comprisesreal-and-virtual combined environments and human-machine interactionsgenerated by computer technology.

As used in the description herein and throughout the claims that follow,the meaning of “a,” “an,” and “the” includes plural reference unless thecontext clearly dictates otherwise. Also, as used in the descriptionherein, the meaning of “in” includes “in” and “on” unless the contextclearly dictates otherwise.

Unless the context dictates the contrary, all ranges set forth hereinshould be interpreted as being inclusive of their endpoints, andopen-ended ranges should be interpreted to include only commerciallypractical values. Similarly, all lists of values should be considered asinclusive of intermediate values unless the context indicates thecontrary.

The recitation of ranges of values herein is merely intended to serve asa shorthand method of referring individually to each separate valuefalling within the range. Unless otherwise indicated herein, eachindividual value with a range is incorporated into the specification asif it were individually recited herein. All methods described herein canbe performed in any suitable order unless otherwise indicated herein orotherwise clearly contradicted by context. The use of any and allexamples, or exemplary language (e.g. “such as”) provided with respectto certain embodiments herein is intended merely to better illuminatethe invention and does not pose a limitation on the scope of theinvention otherwise claimed. No language in the specification should beconstrued as indicating any non-claimed element essential to thepractice of the invention.

Groupings of alternative elements or embodiments of the inventiondisclosed herein are not to be construed as limitations. Each groupmember can be referred to and claimed individually or in any combinationwith other members of the group or other elements found herein. One ormore members of a group can be included in, or deleted from, a group forreasons of convenience and/or patentability. When any such inclusion ordeletion occurs, the specification is herein deemed to contain the groupas modified thus fulfilling the written description of all Markushgroups used in the appended claims.

Unfortunately, the known platform use two camera at the differentplaces, for example one is at a lecture room and the other is on amobile phone. Thus, there is still a need for a system for coordinatingseparate worn and carried cameras on a single person.

SUMMARY OF THE INVENTION

The inventive subject matter provides apparatus, systems and methods forcoordinating at least one separate worn camera and a carried camera on asingle person. At least one worn camera is possessed by a person andimages are captured by the worn camera. The captured images are viewedat real-time by the person in the presence of a mobile and/or acomputer.

The position of the worn camera is adjusted according to the viewingdirection. In some embodiments, the worn camera is set on the back ofthe person's head, allowing you to see views which are not possible tosee by your eye sight, such that expand your eye sight limitation. Insome embodiments, the focus range of the worn camera is different fromthe focus range of the person's eye, allowing to see more details of theobject or very far from your position which are not possible to see,thereby augmenting the person's sense of sight. In some embodiments, aspecial filter, for example, an UV filter is installed on the worncamera, allowing the person to see the object which is not normallyseen. In addition, the combination of some embodiments can be used forimaging.

Various objects, features, aspects and advantages of the inventivesubject matter will become more apparent from the following detaileddescription of preferred embodiments, along with the accompanyingdrawing figures in which like numerals represent like components.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram illustrating a distributed dataprocessing environment.

FIG. 2 is a schematic of a method of augmenting a first image by using asecond camera to provide additional context.

FIG. 3 depicts a block diagram of components of the server computerexecuting the mixed reality engine within the distributed dataprocessing environment of FIG. 1 .

FIG. 4 depicts one embodiment of how a worn camera and a held camera canbe operated by a user.

DETAILED DESCRIPTION

It should be noted that while the following description is drawn to acomputer-based imaging system, various alternative configurations arealso deemed suitable and may employ various computing devices includingservers, interfaces, systems, databases, engines, controllers, or othertypes of computing devices operating individually or collectively. Oneshould appreciate the computing devices comprise a processor configuredto execute software instructions stored on a tangible, non-transitorycomputer readable storage medium (e.g., hard drive, solid state drive,RAM, flash, ROM, etc.). The software instructions preferably configurethe computing device to provide the roles, responsibilities, or otherfunctionality as discussed below with respect to the disclose apparatus.In especially preferred embodiments, the various servers, systems,databases, or interfaces exchange data using standardized protocols oralgorithms, possibly based on HTTP, HTTPS, AES, public-private keyexchanges, web service APIs, known financial transaction protocols, orother electronic information exchanging methods. Data exchangespreferably are conducted over a packet-switched network, the Internet,LAN, WAN, VPN, or other type of packet switched network.

One should appreciate that the inventive subject matter provides asystem or method that allows users to view images captured by a worncamera by use of a mobile phone and/or a computer. Some aspects of theinventive subject matter include a method of providing a system thatenables people (e.g., the third party) to view environment surroundingthe person at real-time and/or later, and/or to select the visiblefocusing range and the range of visible wavelength which are in therange of human eyes, such that expanding the sight capability.

The following discussion provides many example embodiments of theinventive subject matter. Although each embodiment represents a singlecombination of inventive elements, the inventive subject matter isconsidered to include all possible combinations of the disclosedelements. Thus if one embodiment comprises elements A, B, and C, and asecond embodiment comprises elements B and D, then the inventive subjectmatter is also considered to include other remaining combinations of A,B, C, or D, even if not explicitly disclosed.

FIG. 1 is a functional block diagram illustrating a distributed dataprocessing environment.

The term “distributed” as used herein describes a computer system thatincludes multiple, physically distinct devices that operate together asa single computer system. FIG. 1 provides only an illustration of oneimplementation and does not imply any limitations with regard to theenvironments in which different embodiments may be implemented. Manymodifications to the depicted environment may be made by those skilledin the art without departing from the scope of the invention as recitedby the claims.

Distributed data processing environment 100 includes held camera 104,worn camera 114, and server computer 108, interconnected over network102. Network 102 can include, for example, a telecommunications network,a local area network (LAN), a wide area network (WAN), such as theInternet, or a combination of the three, and can include wired,wireless, or fiber optic connections. Network 102 can include one ormore wired and/or wireless networks that are capable of receiving andtransmitting data, voice, and/or video signals, including multimediasignals that include voice, data, and video information. In general,network 102 can be any combination of connections and protocols thatwill support communications between held camera 104, server computer108, and any other computing devices (not shown) within distributed dataprocessing environment 100.

It is contemplated that held camera 104 and worn camera 114 can be anyprogrammable electronic computing devices capable of communicating withvarious components and devices within distributed data processingenvironment 100, via network 102. It is further contemplated that heldcamera 104 and worn camera 114 can execute machine readable programinstructions and communicate with any devices capable of communicationwirelessly and/or through a wired connection. As depicted, held camera104 includes an instance of user interface 106. However, it iscontemplated that any electronic device mentioned herein can include aninstance of user interface 106.

User interface 106 provides a user interface to augmentation engine 110.Preferably, user interface 106 comprises a graphical user interface(GUI) or a web user interface (WUI) that can display one or more oftext, documents, web browser windows, user option, applicationinterfaces, and operational instructions. It is also contemplated thatuser interface can include information, such as, for example, graphics,texts, and sounds that a program presents to a user and the controlsequences that allow a user to control a program.

In some embodiments, user interface can be mobile application software.Mobile application software, or an “app,” is a computer program designedto run on smart phones, tablet computers, and any other mobile devices.

User interface 106 can allow a user to register with and configureaugmentation engine 110 (discussed in more detail below) to enable auser to access a mixed reality space. It is contemplated that userinterface 106 can allow a user to provide any information toaugmentation engine 110.

Server computer 108 can be a standalone computing device, a managementserver, a web server, a mobile computing device, or any other computingsystem capable of receiving, sending, and processing data.

It is contemplated that server computer 108 can include a servercomputing system that utilizes multiple computers as a server system,such as, for example, a cloud computing system.

In other embodiments, server computer 108 can be a computer systemutilizing clustered computers and components that act as a single poolof seamless resources when accessed within distributed data processingenvironment 100.

Database 112 is a repository for data used by augmentation engine 110.In the depicted embodiment, augmentation engine 110 resides on servercomputer 108. However, database 112 can reside anywhere within adistributed data processing environment provided that augmentationengine 110 has access to database 112.

Data storage can be implemented with any type of data storage devicecapable of storing data and configuration files that can be accessed andutilized by server computer 108. Data storage devices can include, butare not limited to, database servers, hard disk drives, flash memory,and any combination thereof.

FIG. 2 is a schematic of a method of enhancing situational context usinga held camera and a worn camera.

Augmentation engine 110 receives a first image from a worn camera (step202).

As used herein, worn camera 114 can comprise any imaging device that iscapable of limited control.

In an exemplary embodiment, worn camera 104 is a small camera attachedto a user's clothing to provide a substantially fixed perspective from apredesignated vantage point. For example, the predesignated vantagepoint can be limited to a camera pinned to a user's shirt and pointedsubstantially orthogonally relative to the surface of the user's chest.

In other embodiments, worn camera 114 may not be worn by a user.Instead, worn camera 114 can also include any one or more camera havinglimited user control. For example, worn camera 114 can include a 360degree camera fixed in a user's room. In another example, worn camera114 can be a network of cameras that record different fixed perspectivesof the same environment. In yet another example, worn camera 114 can beaugmented reality glasses with a built-in camera.

It is further contemplated that augmentation engine 110 receives animage from worn camera 114 in real-time. However, it is alsocontemplated that augmentation engine 110 can receive an image from worncamera 114 with a delay, including, for example, a 1 second, 10 second,or 1 minute lag.

Augmentation engine 110 receives a user second image from a held camera(step 204).

As used herein, held camera 104 can comprise any imaging device that iscapable of independent control. In an exemplary embodiment, hand heldcamera 104 is a smart phone camera held by a user.

In another embodiment, hand held camera 104 is a camera held by someoneother than the primary user. For example, hand held camera 104 can be acamera held by a camera operator to document the environment of the userin finer detail.

In other embodiments, hand held camera 104 does not have to be heldphysically, and instead, includes any camera that is independentlycontrolled. For example, hand held camera 104 can be a non-autonomous,partially autonomous, and/or autonomous drone with a camera. In anotherexample, hand held camera 104 can be a network of cameras recordingvarious aspects of a subjects environment.

Augmentation engine 110 is not limited to static images, and can receiveany one or more types of media data. For example, augmentation engine110 can receive a photo. In another example, augmentation engine 110 canreceive a video. In yet another example, augmentation engine 110 canreceive a three dimensional mapping of an object. In a last example,augmentation engine 110 can receive enhanced imaging data, such as UVfiltered images, to highlight environmental features that are outside ofthe visible spectrum for humans.

Augmentation engine 110 determines the context of the second image (step206).

It is contemplated that augmentation engine 110 can determine thecontext of the second image in any manner known in the art.

In one embodiment, augmentation engine 110 receives the context of thesecond image directly from a user via user interface 106. For example, auser pointing a smart phone can input “water bottle” for a capturedimage of a water bottle using a touch screen user interface. In anotherexample, a second individual can identify and input the context of thesecond image into augmentation engine 110.

In another embodiment, augmentation engine 110 determines the context ofthe second image using one or more analytical techniques. Analyticaltechniques are contemplated to include algorithms, including, forexample machine learning algorithms. Machine learning algorithms caninclude any artificial intelligence based algorithms, including, forexample, supervised learning classification, time series classification,and linear regression analysis.

For example, augmentation engine 110 can use a time seriesclassification and a supervised learning classification to determinewhat the subject of an image is. Based on a determination that the imagewas taken at night during the month of December, augmentation engine 110can narrow down the image to a list of 1000 potential objects. Using asupervised learning classifier, augmentation engine 110 can analyze thefeatures of the image to determine which of the 1000 potential objectmatch the visual features of the subject. Based on the combination ofanalyses, augmentation engine 110 can determine that the object in thephotograph is a Christmas tree with twinkling lights.

In an alternative embodiment, augmentation engine 110 makes nodetermination about the context of the second image. For example,augmentation engine 110 can simply receive a particular photograph takenby the user and tied to a particular location and position. In thisembodiment, it is contemplated that the second image can be provided toa user without context added (e.g., an image-based placeholder in anenvironment).

In some embodiments, augmentation engine 110 makes a determination aboutthe context of an image based on crowd-sourced data. For example,augmentation engine 110 can allow a game streamer's followers to addtags relating to the context of one or more elements in the streamer'senvironment. Followers can identify the environment as “streamer'sbedroom” and an award on the streamer's desk as a “Streamer of the Year”award from a popular gaming website. As more and more followers submitadditional context to an environment, it is contemplated thataugmentation engine 110 can provide more context to the environment overtime. Additionally, the context can be updated by followers insubstantially real-time, thereby keeping the context of the environmentupdated.

Augmentation engine 110 augments the first image with the second image(step 208).

Augmentation engine 110 can augment the first image with the secondimage in any manner known in the art.

In one embodiment, augmentation engine 110 automatically includes thecontext of the second image within the environment of the first image.For example, augmentation engine 110 can incorporate the context ofevery element in the first image simultaneously.

For example, augmentation engine 110 can automatically include a smallscreen in the top right corner of user interface 106 that shows arear-view perspective from a worn camera 114 on the back of a user.

In another example, augmentation engine 110 can automatically include azoomed in view of particular objects in a user's environment as theobjects fall within the user's line of sight.

However, it is also contemplated that augmentation engine 110 canprovide context in response to an action of the user. For example, theuser can toggle various views, including, for example, rear-view andzoomed-in views, at their discretion, and augmentation engine 110 canprovide context associated with one or more user inputs.

In other embodiments, augmentation engine 110 filters context ofmultiple second images associated with the environment of the firstimage to selectively display the contexts of particular sets of secondimages. For example, in response to a user toggling an option to onlysee context for mixed media arts, augmentation engine 110 can filter outall context associated with non-mixed art mediums (e.g., painting oncanvas, sketch on paper, etc.).

In alternative embodiments, augmentation engine 110 filters the contextsof second images and also censors the first and/or second images toobfuscate the content. For example, in response to a viewer being 10years old, augmentation engine 110 can automatically filter out contextassociated with alcohol and tobacco references. In another example, inresponse to a viewer's selection of interests, augmentation engine 110can automatically focus on the most relevant context to the viewer'sinterests.

In a related example, augmentation engine 110 can censor particularsecond images based on the context associated with the second image.

Augmentation engine 110 communicates the context of the second imagewithin the context of the first image (step 210).

Augmentation engine 110 can communicate the context of the second imageautomatically and/or manually.

In one embodiment, augmentation engine 110 automatically displays thecontext of the image. For example, augmentation engine 110 canautomatically displays that an award in a subject's room is forparticipating in a college football championship game. Augmentationengine 110 can additionally include information about the stats of thesubject during the season.

In a similar embodiment, augmentation engine 110 automatically displaysthe context of the second image in response to a trigger. In a virtualenvironment, for example, augmentation engine 110 can automaticallydisplay the context of an object within the environment, if a viewerpans their view of the environment to focus on the object and keepstheir focus trained on the object for more than three seconds.

In another embodiment, augmentation engine 110 indicates elements in theenvironment of the first image are selectable to provide more contextabout each of the elements. For example, augmentation engine 110 canplace a symbol over a number of objects in the environment of the firstimage that have additional context. Upon a user clicking a symbol abovea subject's computer, augmentation engine 110 can produce a pop-up withadditional information about the subject's computer specifications andgames frequently played by the subject.

In yet another embodiment, augmentation engine 110 simultaneouslydisplays the context of the second image and the first image. Forexample, augmentation engine 110 can be configured to always renderbackground information about permanent art installments in an augmentedreality tour of a museum.

Alternatively, augmentation engine 110 can cause a device to execute oneor more actions instead of communicating the context of the second imagewithin the context of the first image.

In one alternative example, augmentation engine 110 can cause heldcamera 104 to automatically take a picture when a target subject, asidentified using worn camera 114, falls into view of held camera 104.

In another alternative example, a user can take a picture of an objectusing held camera 104 and send the captured image and associatedmetadata to augmentation engine 110. Augmentation engine 110 can thencause a fixed camera in a venue (worn camera 114) to shift itsperspective to focus on the object in the picture.

In yet another alternative example, a user take a picture of a specificperson in a venue using held camera 104 and send the captured image andassociated metadata to augmentation engine 110. Augmentation engine 110can then analyze one or more feeds from fixed cameras in the venue toidentify and alert the user when the specific person falls into view ofa fixed camera.

In another alternative embodiment, held camera 104 can be a mobilecamera and worn camera 114 can be a stationary camera. For example, asearcher holding a smart phone can be on the ground looking in specificspots for a lost child, while a coordinator views a stationarycamera/worn camera 114 showing a birds-eye view from above. Thecoordinator can direct the searcher to particular search areas whileviewing what the searcher sees through a live feed from the smartphone/held camera 104.

FIG. 3 depicts a block diagram of components of the server computerexecuting augmentation engine 110 within the distributed data processingenvironment of FIG. 1 . FIG. 3 is not limited to the depictedembodiment. Any modification known in the art can be made to thedepicted embodiment.

In one embodiment, the computer includes processor(s) 304, cache 314,memory 306, persistent storage 308, communications unit 310,input/output (I/O) interface(s) 312, and communications fabric 302.

Communications fabric 302 provides a communication medium between cache314, memory 306, persistent storage 308, communications unit 310, andI/O interface 312. Communications fabric 302 can include any means ofmoving data and/or control information between computer processors,system memory, peripheral devices, and any other hardware components.

Memory 306 and persistent storage 308 are computer readable storagemedia. As depicted, memory 306 can include any volatile or non-volatilecomputer storage media. For example, volatile memory can include dynamicrandom access memory and/or static random access memory. In anotherexample, non-volatile memory can include hard disk drives, solid statedrives, semiconductor storage devices, a read-only memory (ROM), anerasable programmable read-only memory (EPROM), a flash memory, and anyother storage medium that does not require a constant source of power toretain data.

In one embodiment, memory 306 and persistent storage 308 are randomaccess memory and a hard drive hardwired to held camera 104,respectively. For example, held camera 104 can be a computer executingthe program instructions of augmentation engine 110 communicativelycoupled to a solid state drive and DRAM.

In some embodiments, persistent storage 308 is removable. For example,persistent storage 308 can be a thumb drive or a card with embeddedintegrated circuits.

Communications unit 310 provides a medium for communicating with otherdata processing systems or devices, including data resources used byheld camera 104. For example, communications unit 310 can comprisemultiple network interface cards. In another example, communicationsunit 310 can comprise physical and/or wireless communication links.

It is contemplated that augmentation engine 110, database 112, and anyother programs can be downloaded to persistent storage 308 usingcommunications unit 310.

In a preferred embodiment, communications unit 310 comprises a globalpositioning satellite (GPS) device, a cellular data networkcommunications device, and short to intermediate distance communicationsdevice (e.g., Bluetooth®, near-field communications, etc.). It iscontemplated that communications unit 310 allows held camera 104 tocommunicate with other computing devices 104 associated with otherusers.

Display 318 is contemplated to provide a mechanism to displayinformation from augmentation engine 110 through held camera 104. Inpreferred embodiments, display 318 can have additional functionalities.For example, display 318 can be a pressure-based touch screen or acapacitive touch screen.

In yet other embodiments, display 318 can be any combination of sensoryoutput devices, such as, for example, a speaker that communicatesinformation to a user and/or a vibration/haptic feedback mechanism. Forexample, display 318 can be a combination of a touch screen in thedashboard of a car, a voice command-based communication system, and avibrating bracelet worn by a user to communicate information through aseries of vibrations.

It is contemplated that display 318 does not need to be physicallyhardwired components and can, instead, be a collection of differentdevices that cooperatively communicate information to a user.

FIG. 4 illustrates a system or platform of inventive subject matter isused to coordinate worn camera 114 and held camera 104. As used in thisapplication, range of focus for the worn camera 114 is different fromthat for wearer's eye 402, such that the wearer can receive moredetailed information of an object.

Worn camera 114 can use any imaging technologies known in the art. Insome embodiments, worn camera 114 is a conventional camera that capturesimages within the visible wavelengths for humans.

In other embodiments, worn camera 114 incorporates advanced imagingtechnologies. For example, worn camera 114 can incorporate infraredimaging technologies to accurately detect the number of people withinthe environment. In another example, worn camera 114 can takemulti-spectral images. In a more specific example, the wearer caninstall a special filter, for example a UV filter, allowing to detectthe different shape and/or color of the object from those observed byeye.

Additionally, it is contemplated that the image from worn camera 114 canbe processed using any image processing techniques for any imageprocessing objectives known in the art. For example, an image of anenvironment from worn camera 114 can be post-processed using imageprocessing techniques comprising anisotropic diffusion, hidden Markovmodels, image editing, image restoration, independent componentanalysis, linear filtering, neural networks, partial differentialequations, pixilation, principal components analysis, self-organizingmaps, and wavelets. Image processing objectives can include, but are notlimited to, classification, feature extraction, multi-scale signalanalysis, pattern recognition, and projection (i.e., mappingthree-dimensional representations on a two-dimensional plane.

Held camera 104 can use any imaging technologies known in the art. Insome embodiments, held camera 104 is a conventional camera that capturesimages within the visible wavelengths for humans.

In other embodiments, held camera 104, like worn camera 114,incorporates advanced imaging technologies. For example, held camera 104can incorporate infrared imaging technologies to detect whether or notan object that held camera 104 is pointed at produces heat to determinewhether the object has active electronic circuitry. In another example,held camera 104 can take multi-spectral images. In yet another example,a wearer of held camera 104 can install a special filter, for example aUV filter, allowing held camera 104 to detect a different shape and/orcolor of an object from those observed by eye.

As with worn camera 114, held camera 104 can use any image processingtechniques known in the art to further extract relevant information outof one or more images.

It should be apparent to those skilled in the art that many moremodifications besides those already described are possible withoutdeparting from the inventive concepts herein. The inventive subjectmatter, therefore, is not to be restricted except in the scope of theappended claims. Moreover, in interpreting both the specification andthe claims, all terms should be interpreted in the broadest possiblemanner consistent with the context. In particular, the terms “comprises”and “comprising” should be interpreted as referring to elements,components, or steps in a non-exclusive manner, indicating that thereferenced elements, components, or steps may be present, or utilized,or combined with other elements, components, or steps that are notexpressly referenced. Where the specification claims refers to at leastone of something selected from the group consisting of A, B, C . . . andN, the text should be interpreted as requiring only one element from thegroup, not A plus N, or B plus N, etc.

What is claimed is:
 1. A method of engaging a viewer in augmentedreality using a first electronic device including a first camera and adisplay and a second electronic device including a second camera, themethod comprising: receiving, by one or more computer processors, afirst image from the first camera; identifying, by the one or morecomputer processors, an object associated with the first image;receiving, by the one or more computer processors, a second image fromthe second camera, wherein the second camera is configured to focus onthe object, and wherein the second image at least includes an infraredimage; determining, by the one or more computer processors, a context ofthe second image within the context of the first image; and displaying,by the one or more computer processors, the first image, wherein thefirst image includes the context of the second image within the contextof the first image.
 2. The method of claim 1, wherein the second imageand the context of the second image are composited into the first image.3. The method of claim 2, wherein the contextual significance of thesecond image is a superimposition of context data on the first image. 4.The method of claim 1, further comprising: storing, by acomputer-readable storage medium, the second image and the context ofthe second image for a predetermined time period; receiving, by acomputer processor, a request to view the second image and the contextof the second image within the predetermined time period; andsuperimposing, by a computer processor, the second image and the contextof the second image onto the first image via the display of the firstelectronic device.
 5. The method of claim 4, wherein superimposing thesecond image and the context of the second image is rendered insubstantially real-time.
 6. The method of claim 4, further comprisingthe step of storing, by the computer-readable storage medium, thesuperimposed second image for later retrieval.
 7. The method of claim 4,further comprising the step of storing, by the computer-readable storagemedium, the context of the second image for later retrieval.